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APPARATUS FOR AND METHOD OF RENDERING 3D OBJECTS WITH 
PARAMETRIC TEXTURE MAPS 

RELATED U.S. APPLICATION 

This application is a continuation-in-part to the commonly owned, 
co-pending patent application, Serial Number 09/528,700, Attorney Docket 
Number HP-10002119-1, entitled "Apparatus for and Method of Rendering 
3D Objects with Parametric Texture Maps," with filing date March 17, 
2000 and assigned to the assignee of the present invention. 

TECHNICAL FIELD 

The present invention relates generally to the field of computer 
graphics and pertains more particularly to an apparatus for and method 
of rendering three-dimensional (3D) objects with parametric texture maps 
in a computer graphics system. 



BACKGROUND ART 

Modern computer systems have become increasingly graphics 
intensive. Dedicated special purpose memories and hardware have 

20 been developed to meet this need. A conventional computer graphics 

system includes a display device having a two-dimensional (2D) array of 
light emitting areas. The light emitting areas are usually referred to as 
pixels which is an abbreviation for picture elements. Such a graphics 
system typically employs hardware, software, or both to generate a 2D 

25 array of values that determine the colors or shades of grey that are to be 
emitted from the corresponding pixels of the display. 



Computer graphics systems are commonly employed for the 
display of 3D objects. Typically, such a system generates what appears 

30 to be a 3D object on a 2D display by generating 2D views of the 3D object 
that is modeled in the computer memory. The 2D view of a 3D object 
which is generated at a particular time usually depends at least on a 
spatial relationship between the 3D object and a viewer of the 3D object at 
the particular time. This spatial relationship may be referred to as the 

35 view or eye point direction. For example, a car is a 3D object having a 
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front and a back. However, whether one can see the taillights will 
depend on where one is viewing the car from. A view direction that is 
directly in front of the car will not show the taillights while a view 
direction that is directly behind the car will. 

5 

The process by which a computer graphics system generates the 
values for a 2D view of a 3D object is commonly referred to as image 
rendering or scan conversion. The graphics system usually renders a 
3D object by subdividing the 3D object into a set of polygons and rendering 
10 each of the polygons individually. 

The values for a polygon that are rendered for a particular view 
direction usually depend on the surface features of the polygon and the 
II effects of lighting on the polygon. The surface features include details 
15 such as surface colors and surface structures. The effects of lighting 
|* usually depend on a spatial relationship between the polygon and one or 
more light sources. This spatial relationship may be referred to as the 

3 light source direction. For example, if there is only one light source, the 

14 

|| side of the object closest to the light source will be illuminated while the 

- 20 side of the object furthest from the light source might be in shadow. 

U 

U 

Typically, the evaluation of the effects of lighting on an individual 
pixel in a polygon for a particular view direction involves a number of 3D 
vector calculations. One of ordinary skill in the art will recognize that 
25 the standard Blinn/Phong lighting equation is as follows: 

/= kj a + k d I d (N>L) + kJ s (N'H) n (1) 

where k d , and k s are constants. Equation (1) states that the light 
30 intensity / for a particular pixel is a function of the sum of the ambient 
contribution I a , the diffuse contribution I d , and the specular contribution 
I s , at that location. Lighting calculations based on Equation 1 include 
floating-point, square-root and divide operations when used with 
normalized vectors. Such calculations are usually time consuming and 
35 expensive whether performed in hardware or software. 
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One conventional method for reducing such computation 
overhead is to evaluate the effects of lighting at just a few areas of a 
polygon, such as the vertices, and then to interpolate the results across 
5 the entire polygon. Examples include methods which are commonly 

referred to as flat shading and Gouraud shading. Such methods usually 
reduce the number of calculations that are performed during scan 
conversion and thereby increase rendering speed. Unfortunately, such 
methods also usually fail to render shading features that are smaller 
10 than the areas of individual polygons. If the polygons are relatively 
large, the view will be noticeably distorted. 

* One conventional method for rendering features that are smaller 

13 than the area of a polygon is to employ what is commonly referred to as a 

r; 15 texture map. A typical texture map is a table that contains a pattern of 

f * color values for a particular surface feature. For example, a wood grain 

s§ surface feature may be rendered using the surface and a texture map 

I that holds a color pattern for wood grain. Unfortunately, texture 

U mapping usually yields relatively flat surface features that do not 

HI 

l$Q change with the view direction or light source direction. The 

l*t appearance of real 3D objects, on the other hand, commonly do change 

with the view direction, light source direction, or both. These directional 
changes are commonly caused by 3D structures on the surface of the 
object, that is, the object is not perfectly flat. Such structures can cause 
25 localized shading or occlusions or changes in specular reflections from 
a light source. The effects can vary with view direction for a given light 
source direction and can vary with light source direction for a given view 
direction. These directional changes should be accounted for to provide 
greater realism in the rendered 2D views. 

30 

One conventional method for handling the directional dependence 
of such structural effects in a polygon surface is to employ what is 
commonly referred to as a bump map. A typical bump map contains a 
height field from which a pattern of 3D normal vectors for a surface are 
35 extracted. The normal vectors are used to evaluate lighting equations at 
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each pixel in the surface. Unfortunately, such evaluations typically 
involve a number of expensive and time consuming 3D vector 
calculations including division and square roots. This can result in 
decreased rendering speed or increased graphics system cost. 

A definite need exists for a system having an ability to meet the 
efficiency requirements of graphics intensive computer systems. In 
particular, a need exists for a system which is capable of rendering 2D 
views of a 3D object in a skillful manner. Ideally, such a system would 
have a lower cost and a higher productivity than conventional systems. 
With a system of this type, system performance can be enhanced. A 
primary purpose of the present invention is to solve this need and 
provide further, related advantages. 
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DISCLOSURE OF THE INVENTION 

A graphics system is disclosed that employs parametric texture 
maps. The graphics system renders surface features of a 3D object in a 
manner that is direction dependent but without the time consuming and 
expensive calculations involved in the evaluation of lighting equations on 
a per pixel basis. A parametric texture map holds a set of parameters 
that define a surface structure in a manner in which the appearance of 
the surface structure varies in response to a direction vector. The 
direction vector may be any user-defined vector including a light source 
vector or a half-angle vector. The parameters are those of a 
predetermined equation, the evaluation of which does not involve vector 
calculations. The equation may take any form including a polynomial 
equation or a non-polynomial equation. The graphic system renders a 
polygon with the surface structure using the equation. 

A method of generating a parametric texture map of a subject in 
order to render an image under varying conditions is disclosed, in 
accordance with embodiments of the present invention. The parametric 
texture map contains at least one varying parameter in a set of varying 
parameters for an equation that defines variation in pixel color. Each 
varying parameter in the equation corresponds to a varying condition or 
effect. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The above and other objects and advantages of the present 
invention will be more readily appreciated from the following detailed 
description when read in conjunction with the accompanying drawing, 
wherein: 

FIG. 1 is a block diagram of a computer graphics system 
according to a preferred embodiment of the present invention; 

FIG. 2 is a graphical representation of a polygon which is defined 
in the buffer of FIG. 1 and which is to be rendered by the graphics 
processor of FIG. 1 using surface features defined by the parametric 
texture map of FIG. 1; 

FIG. 3 is a flow diagram of a method according to the present 
invention for rendering a polygon using surface features defined by a 
parametric texture map; and 

FIGS. 4A-4C illustrate an arrangement for determining the 
coefficients in a parametric texture map for an example surface 
structure employed in the present invention. 

Figure 5 is a flow diagram illustrating steps in a method for 
rendering an image using a parametric texture map, in accordance with 
one embodiment of the present invention. 

Figure 6 is a graphical parametric texture mapping representation 
of color values as a function of a varying condition in one dimension for a 
subpixel of an image, in accordance with one embodiment of the present 
invention. 
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BEST MODES FOR CARRYING OUT THE INVENTION 

Turning first to FIG. 1, a block diagram of a computer graphics 
system 10 according to a preferred embodiment of the present invention 
is shown. The computer graphics system 10 includes a buffer 12, a 
5 graphics processor 14, a parametric texture map 16, a frame buffer 18, 
and a display 20. The buffer 12 holds geometry data that describes a 3D 
object which is to be generated on the display 20. The 3D object is 
represented in the buffer 12 as a set of polygons in a 3D space. In one 
embodiment, the polygons are triangles and the geometry data in the 
10 buffer 12 includes the 3D coordinates of the vertices of the triangles. 

The graphics processor 14 reads the parameters that define the 

14 

U polygons from the buffer 12 and scan converts each polygon. The scan 
^ conversion of a polygon yields a 2D view of the polygon which depends on 
13 15 a view direction and a light source direction. A 2D view of a polygon 
1-4 includes a color value for each pixel of the polygon which is visible in the 
^ plane of the display 20. The graphics processor 14 writes the color values 
§4 for the rendered polygons into the frame buffer 18. The color values from 

the frame buffer 18 are provided to the display 20 on a frame by frame 
1*20 basis. The display 20 can be any conventional 2D display device such as 
j** a raster scan device or flat-panel display device. 

The parametric texture map 16 holds parameters that define a 
surface structure in a manner in which the appearance of the surface 

25 structure varies with any user-defined vector such as the view vector, 
the light source vector, or the half-angle vector. The half-angle vector is 
a vector that is halfway between the view and light vectors. The graphics 
processor 14 maps the surface structure defined in the parametric 
texture map 16 onto the polygons obtained from the buffer 12 during scan 

30 conversion. The result is a more realistic rendering of 3D features in a 
surface on a 3D object in comparison to texture mapping but without the 
computational penalties associated with bump mapping. 
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In one embodiment, the parameters contained in the parametric 
texture map 16 are the Al, A2, A3, A4, A5, and A6 coefficients for 
evaluating the following second order polynomial equation: 

Ci = AID U 2 + A2D U 2 + A3D U D V + A4D U + A5D U + A6 (2) 

where D u and D v , are the 2D components of the user-defined vector. For 
example, if the parametric texture map 16 is adapted to the view 
direction then D u and D v are the 2D 

components of an eye point vector. Likewise, the terms D u and D v are the 
2D components of a half-angle vector if the parametric texture map 16 is 
adapted to the half-angle vector. 

TABLE 1 illustrates the general contents of the parametric texture 
map 16. The parametric texture map 16 contains n by m entries. Each 
of the n by m entries corresponds to a sample of a particular surface 
modeled by the parametric texture map 16. These samples may be 
referred to as texels which is an abbreviation for texture elements. The 
coefficients for an individual texel are denoted as Al tj to AGy wherein i 
ranges from one to n and j ranges from one to m. 
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TABLE 1 



A3 i,i A4 i,i 
A5 U A6 1A 


Al 12 A2 12 
A3 12 A4 12 
A5 12 A6 12 




Al Um A2 1>m 
A3^ m A4 lm 
A5 Um A6 hm 


Al v A2 2>1 
A3 21 A4 21 
A5 2J A6 21 


Al 22 A2 22 
A3 22 A4 22 
A5 22 A6 22 




Al 2>m A2 2m 
A3 2 m A4 2 m 
A5 2 m A6 2m 










Al nJ A2 n>1 
A3 nJ A4 nJ 
A5 na A6 na 


Al n , 2 A2 ni2 
A3 n , 2 A4 n _ 2 
A5 ni2 A6 n2 




Al nm A2 n:m 
A3 n , m A4 n>m 
A5 n , m A6 nm 



N The parametric texture map 16 is representative of a set of 

j| parametric texture maps that may be used for rendering 3D objects in 
* 5 the graphics system 10. Each parametric texture map according to the 
|| present technique is adapted to a particular surface structure that is to 
|J be mapped onto a 3D object. In addition, each parametric texture map is 
|,I adapted to provide realistic 3D rendering in response to the user-defined 
vector. For example, the parametric texture map 16 may be adapted to 
10 provide realistic 3D rendering in response to a varying light source 

direction for a given fixed view direction. Alternatively, the parametric 
texture map 16 may be adapted to provide realistic 3D rendering in 
response to a varying view direction for a given fixed light source 
direction. 

15 

In one embodiment, a parametric texture map may be adapted to 
a particular color channel of the display 20. For example, the graphic 
system 10 may include a separate parametric texture map for each of the 
red, green, and blue channels for an RGB display for a particular 
20 surface structure. One drawback to this approach is that three 
parametric texture maps are required. Alternatively, a single 
parametric texture map may be multiplied with each channel in a 
complete RGB texture map. In this embodiment, the parametric texture 
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map encodes the brightness changes as a result of changes in the light 
vector, for example, and modulates the RGB color values in a 
corresponding texture map to yield the resultant color values. It is also 
possible to render objects illuminated by multiple light sources using 
5 this type of parametric texture map. Since the RGB color values are 
separate from the intensity, the intensity values can be calculated for 
different light sources and combined to get a final intensity value. The 
per-pixel intensity values are then multiplied with the RGB values to get 
the output color. A wide range of useful operations can be achieved by 
10 using different blending modes to combine parametric texture map 
evaluation results with calculated lighting, texture maps, or other 

u sources during texture blending in the graphics pipeline. 

II 

= > t Turning now to FIG. 2, a graphical representation of a polygon 22 

1315 which is defined in the buffer 12 of FIG. 1 and which is to be rendered by 
|4 the graphics processor 14 of FIG. 1 using surface features defined by the 
^ parametric texture map 16 of FIG. 1 is shown. The polygon 22 is defined 
M by a set of three vertices (T 2 , T 2 , and T 3 ) in a 3D space. The local 

coordinate space is represented by a set of u and v axes 24 which are 
N20 usually defined by the spatial texture coordinates of the polygon 22. 

A surface normal vector N for the polygon 22 is shown, along with 
an eye point vector V, a light source vector L, and a half-angle vector H. 
Note that normal vectors are usually defined for the vertices rather than 

25 the entire polygon to improve realism. Here a single normal for the 

polygon is illustrated for simplicity. The eye point vector V represents a 
view direction from a pixel P k of the polygon 22 to an eye point 26. The 
light source vector L represents a light source direction from the pixel P k 
to a light source 28. The half-angle vector H represents the vector that is 

30 halfway between the eye point vector V and the light source vector L. 
Also shown is a (V u , V v ) vector which is the eye point vector V projected 
down into the plane of the polygon 22. Likewise, a (L u , L v ) vector is the 
projection of the light source vector L and a (H u , H v ) vector is the 
projection of the half-angle vector H. 
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FIG. 3 shows a flow diagram of a method according to the present 
invention for rendering a polygon using surface features defined by a 
parametric texture map. The steps shown are used to generate a color 
5 value for each of a set of pixels in the polygon 22 of FIG. 2. The following 
description for purposes of illustration focuses on the pixel P k of FIG. 2 
as an example. The coefficients Al tj to Ao^ in the parametric texture 
map 16 of FIG. 1 are adapted to yield color values in response to a 
user-defined vector such as a light source vector or an half-angle vector. 
10 This adaptation is done by using linear regression from a set of images 
that provide color values at each pixel for varying vector directions. The 
14 following description for purposes of illustration focuses on an example 
% in which the coefficients Al {j to A6 tj are adapted to yield color values in 
g| response to a light source vector for a fixed eye point vector. 
"!15 Nevertheless, these techniques are readily applicable to a parametric 
N; texture map which contains coefficients that are adapted to yield color 
I ™ values in response to any user-defined vector. In addition, the 

coefficients Al i} to A6 tj in the parametric texture map 16 yield color 
values for a particular color channel of the display 20 of FIG. 1. 
|j20 Additional parametric texture maps may be used to yield color values for 
|* the remaining channels. The steps are repeated with each polygon in 
the set of polygons representing the 3D object that is stored in the buffer 
12 of FIG. 1. The process begins at START. 

25 At step 30, the graphics processor 14 of FIG. 1 assigns spatial 

texture coordinates u and v of the parametric texture map 16 at each 
vertex T v T 2 , and T 3 of the polygon 22. The spatial texture coordinates for 
the vertices T i5 T 2 , and T 3 are denoted as u T1 , v T1 , u T2 , v T2 , and u T3 , v T3 , 
respectively. 

30 

At step 32, the graphics processor 14 determines direction vectors 
at the vertices of the polygon 22. The direction vectors in this example 
are light source vectors at the vertices of the polygon 22. The light source 
vector at the vertex T 1 is a normalized 3D vector that points from T 1 to the 
35 3D coordinates of the light source 28 of FIG. 2. Similarly, the light 
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source vector at the vertices T 2 and T 3 are normalized 3D vectors that 
point from T 2 and T 3 , respectively, to the 3D coordinates of the light 
source 28. 

5 At step 34, the graphics processor 14 projects the normalized 3D 

direction vectors determined at step 32 into the texture coordinate system 
u and v of the parametric texture map 16. This yields 2D 
parameterization or 2D components of each normalized 3D direction 
vector in the texture coordinate system of the parametric texture map 16. 
10 A 2D parameterization of a normalized 3D direction vector is denoted as 
D u > A,- 

%'» At step 36, the graphics processor 14 interpolates the projected 

O direction vectors D u , D v determined at step 34 and spatial texture 

q}15 coordinates u T1 , v T1 , v T2 , and u T3 , v T3 determined at step 30 across the 

f ; polygon 22. This associates each pixel of the polygon 22 with D u , D v 

ii parameters and with u and v texel coordinates in the coordinate space of 

i the parametric texture map 16. The interpolation of step 36 may be 

p performed using a variety of known techniques. 

At step 38, the graphics processor 14 obtains the polynomial 

I* 

coefficients Al tj to A6 tJ from the parametric texture map 16 and 
interpolates them. It is important to note that there are several options 
for evaluating and interpolating the texture map. Interpolated texture 

25 coordinates will not yield exact texels in the input texture map so texture 
interpolation is needed. These interpolation methods are well known 
and include nearest-neighbor, bilinear, trilinear, and anisotropic 
interpolation. One option is to evaluate the polynomial at each of the 
sample points and then to interpolate the output value. Another option 

30 is to interpolate the polynomial coefficients to generate an interpolated 
polynomial and then to evaluate the polynomial. FIG. 3 illustrates the 
second option. 

At step 40, the graphics processor 14 evaluates Equation (2) using 
35 the interpolated D u and D v terms from step 36 and the interpolated 
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coefficients Al tj to A6 tj from step 38 on a per pixel basis. For pixel P k , 
Equation (2) yields a texel value C t which may then be used as a color 
value, luminance value, or other pixel or texture data. 

5 It is generally the case that parametric texture mapping effects 

should only be applied to polygons that are front facing relative to the 
user-defined vector being used. In order to identify front facing and back 
facing polygons, a third variable is used. This third parameter D is 
typically the result of projecting the user-defined vector onto the vertex 
10 normal vectors. For front facing polygons, D will be positive and for back 
facing polygons, D will be negative. Fundamentally, D is the dot product 
between the vertex normal vector and the user defined vector. It may or 
may not be desirable to have the parametric texture mapping effects stop 
13 abruptly at the transition from front facing to back facing. If desirable, 
r=Jl5 the user can attenuate the effects to give a sharp or gradual cutoff as 

needed, possibly including evaluation for triangles that are back facing 
with respect to the user-defined vector. 

fl The present techniques model the 3D effects of surface features by 

j ;[20 modeling the contribution of those features to surface colors directly, 
fl The contributions are then represented by the coefficients of Equation (2). 
The present techniques yield a mapping of surface features to a polygon 
that is direction dependent and that provides a quality of realism which 
is comparable to that yielded by the evaluation of lighting equations on a 
25 per pixel basis. Yet the evaluation of Equation (2), a second order 

polynomial, is relatively easy to perform in hardware, software, or both 
in comparison to the evaluation of lighting equations on a per pixel 
basis. The evaluation of Equation (2) involves integer multiply and add 
operations whereas the evaluation of lighting equations involves 
30 floating-point, square-root and divide operations. Although Equation (2) 
has been chosen to be a bi-quadratic polynomial, bi-cubic and higher 
order polynomials could also be used. Even non-polynomial functions 
could be supported by the present techniques. However, more complex 
functions are not currently preferred due to their higher 
35 implementation costs which are currently considered excessive. 
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Turning now to FIGS. 4A-4C, an arrangement for determining 
the coefficients Al tj to A6 y of the parametric texture map 16 of FIG. 1 for 
an example surface structure 42 is illustrated. FIG. 4A shows a top 
5 view of the surface structure 42. The surface structure 42 is shown 

aligned to a pair of axes D u and D v . The surface structure comprises an 
array of square right pyramid structures 44-52. A sub area 54 
represents one of the texels of the surface structure. The surface 
structure is just one example of a surface structure and any imaginable 
10 surface structure may be modeled using the present techniques. 

FIG. 4B shows a side view of the surface structure 42 of FIG. 4A 
along with a hemispherical dome 56 which is used to position a camera 
58 and a light source. In this case, a single light source is shown 
N 15 positioned at two example positions 60 and 62 on the dome. A vector 64 
represents a light source vector for the position 60 and a vector 66 
represents a light source vector for the position 62. 

r* 
12 

- 1 The camera 58 is fixed in its position on the dome 56 when 

20 obtaining coefficients for a parametric texture map 16 that is adapted to 
yield color values in response to the light source vector. A vector 68 
represents the eye point vector for the fixed position of the camera. The 
camera is used to obtain an image of the surface structure 42 for each of 
a set of predetermined positions of the light source on the dome 56. Each 
25 predetermined position of the light source represents a different light 
source vector and the corresponding image obtained with the camera 
yields a color value for each texel of the surface structure 42. For 
example, images obtained from n different positions of the light source 
yields n color values for each texel with each color value corresponding 
30 to a different light source vector for the eye point vector 68. 

FIG. 4C shows a graph of the color values for the texel 54 obtained 
with the camera 58 for six different positions of the light source on the 
dome 56. These color values include a color value 60' which was 
35 obtained with the light source at position 60 and a color value 62' which 
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was obtained with the light source at position 62. The color values are 
plotted against the axes D u and D v . The coefficients Al i} to A6 tj for the 
texel 54 for the eye point vector 68 are obtained by fitting the polynomial of 
Equation (2) to the color values obtained for the texel 54 using known 
techniques. A surface 70 is shown that represents a fit between the 
polynomial of Equation (2) and the six color values obtained by the 
camera 58 for the texel 54. The fit of the surface 70 to the n color values 
obtained by the camera 58 may be accomplished using standard least 
mean square methods to yield the polynomial coefficients. 

This technique may readily be modified to obtain coefficients for a 
parametric texture map 16 that is adapted to yield color values in 
response to any user-defined vector. For example, the light source may 
be fixed at position 60 which corresponds to the light source vector 64. 
Then the camera 58, representing the eye point vector, is moved to n 
different positions on the dome 56. A surface fit to the obtained color 
values is performed in a manner similar to that described above. 

A further modification of this technique is to combine parametric 
texture maps with existing per-vertex or per-pixel lighting hardware to 
generate a variety of useful effects. One method is to modulate the 
output of standard Blinn/Phong lighting computations by the result of 
evaluating a light vector dependent parametric texture map. By doing 
this, Equation 1 becomes: 

/= kj a + kJ/N'L) + kJ. s (N'H) n PTM(u,v,L u ,L 0 ) (3) 

where PTM is the parametric texture map function as in Equation (2) 
and L u and L v represent the projection of the light source vector L as 
above. In the trivial case where the parametric texture map varies 
spatially but is constant for all incident light directions, Equation (3) 
becomes functionally equivalent to specular maps or gloss maps which 
are well known in the art. The dependence on light direction that is not 
available with conventional specular maps could be used to reproduce 
effects such as shadowing where texels do not exhibit specular 
highlights due to shadowing by small scale surface variations. 
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Another modification is to utilize parametric texture maps to 
simulate off-specular and Fresnel effects. Many surfaces exhibit 
increased specularity for low angles of incidence due to decreases in the 
5 apparent roughness. This can be reproduced using the above technique 
by modulating the specular contribution with a parametric texture map 
whose magnitude increases as the incident angle approaches grazing. 
Incident illumination dependence can also be used to approximate 
Fresnel effects which are well known. Fresnel effects are important for 
10 many surfaces, such as metal and glass, where reflectance increases 
greatly for grazing incident illumination angles. The reflectance of 
glass and other dielectrics are low when the incident direction is nearly 
is equivalent to the surface normal. Metals also exhibit Fresnel reflectance 

including wavelength dependence. As a result, the color of reflected 
l*| 15 light changes as the incident angle changes due to reflectance variations 
r|' for different wavelengths. These dependencies can be approximated by 
il the polynomial function stored at each texel. The combination of these 
y ; illumination dependent effects can all be stored in a single parametric 
13 texture map. In addition, since texel polynomials in the parametric 
i|20 texture map are independent, these properties can vary across the 
i-l surface. As a result, a parametric texture map can represent different 
materials in a single texture map. 

Further still, anisotropic materials, which are well known, can be 
25 modeled using parametric texture maps. An anisotropic material is one 
in which the reflectance function has rotational variation about the 
surface normal. Examples include fur and hair, brushed materials, 
and burnished metals. Conventional techniques to render anisotropic 
materials define normal planes for surface points aligned with the 
30 direction of anisotropy. The projection of the incident light direction into 
the normal plane is then used in the lighting calculations. According to 
the present technique, the function for each texel in the texture map is 
based on the magnitude of the incident light direction projected into the 
normal plane. The result of evaluating the parametric texture map is 
35 then modulated with calculated specular lighting so that specular 
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highlights occur only in regions where the incident light direction 
aligns with the direction of anisotropy. Unlike some conventional 
methods, this technique allows anisotropic materials to be rendered 
under perspective views with local light sources. 

5 

In contrast to well known conventional results, a wide range of 
new effects can also be achieved. This is made possible by using the 
parametric texture map to represent any desired data since the projected 
vector can be assigned by the user directly if desired. Users can choose 
10 to leave one of the parameters constant for representing 

one-dimensional (ID) functions. For example, some time variant 
functions can be represented in this way such as a photographic 
13 sequence of a scene as time varies during the day. One limitation to this 
1 '. effect is that it has difficulty handling scenes that contain abrupt 



PIS changes from frame to frame. 

■jf. 

" y In addition, instead of using the two axes of standard 2D texture 

mapping to encode spatial color variations, the two texture coordinates of 
the texture map can be used as parameters for a bivariate function to 
20 represent the reflectance properties of the object. The present technique 
l'2 has the additional advantage over conventional techniques that instead 
of storing simple color values in the texture map, the present technique 
can store a function of two variables. This function can be controlled by 
the light, eye point, half-angle, or other vectors as desired. Therefore, 
25 the present technique can be used to represent and render objects with 
full four dimensional reflectance functions instead of only two as with 
conventional techniques. Also, unlike conventional techniques, the 
present technique can reproduce effects of local light or viewpoints. 

30 Further still, the present technique can be utilized in volume 

rendering. Instead of simply storing 2D parametric texture maps, 
volume rendering makes use of 3D parametric texture maps. This can 
be visualized as stacks of 2D texture maps. Similar to above, for volume 
rendering, function coefficients are stored for every texel. One can then 

35 render the volume using 3D texture mapping hardware by evaluating 
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the parametric texture map at every texel to determine voxel, unit 
volume element, color values. Additionally, an extra function can be 
used to represent the transparency of each voxel. The parameters for 
the transparency function are specified by the user to allow voxels with 
5 the desired properties to be more or less opaque than other voxels. 

One of the difficulties with using traditional bump maps to display 
surface detail is filtering them to match a particular sampling rate. The 
naive approach of using MIP maps results in smoothing the surface and 
10 thereby removing the bumps themselves. This defeats the purpose of the 

bump map. Upon review, one will realize that the function that one 
|J would like to integrate over is the light radiated from the bumpy patch 
|=| rather than the surface perturbations themselves. Since parametric 
;r texture maps are image-based representations, one can achieve the 
|15 filtering effect by MIP mapping the coefficients A1-A6 themselves. 
" Support for such a conclusion can be realized by considering the 
■ following equation where one is integrating over a patch Q. with n 
f!| samples: 




(4) 



1 * Inspection reveals that the light dependence is linear in the coefficients. 
According to Equation (4), accumulating coefficients over a patch and 
then evaluating the sum is equivalent to accumulating the colors each 

25 texel contributes when independently evaluated. Not only does this allow 
one to MIP map the coefficients directly, but anisotropic filtering 
techniques that yield improved image quality such as footprint assembly 
can also be supported. Therefore there are two options for interpolation 
with parametric texture maps. 

30 

First, one can evaluate the polynomial at all sample points and 
then interpolate the calculated values. Second, parametric texture map 
parameter coefficients can be interpolated from a MlP-map and used to 
evaluate the polynomial. This involves filtering the coefficients into a 
35 precomputed image pyramid, consisting of polynomial coefficients at a 
progressively coarser spatial scale. This texture sample drawing rate is 
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used to select which level of the image pyramid to access. As in 
standard MIP mapping, the level of the pyramid can be a continuous 
value in which case samples from the image pyramid above and below 
this value are interpolated and used to reconstruct the parametric 
5 texture map polynomial. Whether one option is preferred over the other 
will depend on the particular implementation. 

Figure 5 is a flow chart 500 further illustrating steps in a method 
for rendering an image that displays the aforementioned wide range of 
10 new effects, using a parametric texture map, in accordance with one 
embodiment of the present invention. As previously mentioned, a wide 
range of new effects can also be achieved through the use of a 
* parametric texture map to represent any desired data. 

1 15 In step 510, the present embodiment generates a parametric 

■4 texture map of a subject that contains at least one varying parameter for 
Z an equation that defines variation in pixel color. The equation contains a 
set of varying parameters, each of the varying parameters 

u 

corresponding to a varying condition. As such, the set of varying 
"20 parameters is associated with a set of varying conditions. 

In accordance with embodiments of the present invention, the 
parametric texture map is generated without any geometric modeling of 
subject, as is utilized in a bump mapping technique of the prior art. 

25 

For purposes of this Application, the widely used term, "subject," 
is meant to expound on and not to disassociate itself from the previously 
used term, "object." In addition, for purposes of this Application, the 
widely used term, "condition," is meant to expound on and not to 
30 disassociated itself from the previously used term, "effect." 

Furthermore, although the term, "image," is used throughout 
this disclosure, the term is not limited to conventional film based 
photographs or to digital based photographs, but is directed towards all 
35 means of capturing images in one or more dimensions. 
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As previously mentioned, the parametric texture map represents 
any desired data. The sampled data reflects the set of varying conditions 
over a range of conditions. In particular, each of the varying conditions 
5 in the set of varying conditions is sampled over a range within the 

desired dataset or sampled data. The data reflects the pixel color value 
for each of the color channels (e.g., red, green, or blue) that is displayed 
or represented over the range of conditions in the desired dataset. A 
dataset where only one parameter is varied is referred to as varying in 
10 one dimension. A dataset where two parameters are varied is referred 
to as varying in two dimensions, and so on. 

I* 

-i,, In one embodiment, the image is shown on a display. Those well 

i =S known in the art understand the display is comprised of a rectilinear 
13 15 grid of thousands of pixels. Each of the pixels produce a color to form an 
14 image on the display, in the present invention. Color channels, also 
H,i known as subpixels, within each pixel are used to control the spectrum 
|4 of colors available to the pixel and the format to be used in displaying 
s those colors. 

P The diagram 600 in Figure 6 illustrates that the color channels 

have varying color values, in accordance with one embodiment of the 
present invention. On the vertical axis, the color value is represented as 
a value between zero and one, with zero representing the lightest color 

25 value, and one representing the deepest color value. The color values 
are representative of the RGB color values: red, green, and blue color 
values, respectively, in accordance with one embodiment of the present 
invention. For example, in the red color channel, a color value of one 
would give the deepest or fullest red available. A color value of zero 

30 would give the lightest red available. 

The horizontal axis provides a range of values for the varying 
parameter, or varying condition. For purposes of illustration, Figure 6 
shows a dataset varying in one dimension, or varying in one condition. 
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Graph 650 represents color values for a corresponding color channel as 
a function of the condition varying in one dimension. 

Graph 650 in the diagram 600 of Figure 6 shows a dataset of color 
5 values for one particular color channel with three data points: point 610, 
point 620, and point 630. These three points correspond to color values 
for a particular color channel under three separate conditions within 
the varying parameter. 

10 Referring back to the flow chart 500 in Figure 5, the present 

invention performs an interpolation of the dataset to obtain a set of 
y ; coefficients for the equation, in step 520. A set of coefficients is 
|| determined for every color channel for every pixel that is displayed in 
13 creating the image. In each case, the equation is capable of generating 
I s - 15 or interpolating any color value for the color channel over the range of 

I* conditions taken within the dataset. 

vil 

];* For example, Figure 6 provides an interpolation of the dataset of 

|| color values for a particular color channel that varies in one dimension. 
■ '20 The interpolation of the dataset of color values is presented by graph 650 
U in Figure 6. The graph 650 between point 610 and point 630, the 
minimum and maximum conditions, respectively, provides an 
interpolation of the dataset of color values that is capable of generating a 
spectrum of color values over the full range of conditions in the dataset, 
25 for that particular color channel. Combining color values for all the 
color channels of an image, a spectrum of images can be generated 
within the range of conditions in the dataset. 

In one embodiment, instead of storing color values for each 
30 subpixel to produce only one image, coefficients of the equation are 

stored. The equation in one embodiment is a polynomial equation and 
provides color values for a subpixel as a function of the varying condition 
or conditions (parameter or parameters, respectively). In another 
embodiment, the equation is a nonpolynomial equation. The equations 
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for each of the subpixels displayed creates the parametric texture 
modeling of the image under the varying conditions or parameters. 

Returning back to Figure 6, the present embodiment renders the 
5 image by evaluating the equation for every color channel that is 

displayed, in step 630. The equation can be evaluated for every color 
channel, since the coefficients for the equation has been determined for 
every color channel in the previous step 620. The equation is evaluated 
for a given condition, or a given parameter in one dimension. For 
10 equations that vary in more than one dimension, the equation is 

evaluated for a particular condition in each dimension that varies, as 
l4 represented by a given set of parameters in the set of varying 
parameters. 

I 

J* 5 15 Instead of storing the color values for each color channel for every 

I* possible condition, the equation can be evaluated for each color channel 
under all the varying conditions. As such, when the particular 
condition, or set of conditions, is specified, a resulting color value for the 
iiJ color channel can be evaluated from the equation. The technique of 
20 representing each color channel with a red, green, and blue parametric 

y 

U texture map allows for modeling of the changes in the color of a color 
channel due to the changes in the conditions or parameters of the 
equation, in accordance with one embodiment of the present invention. 

25 The variation in the color of a color channel through the range of 

conditions, as defined by the sampled data, is represented with a second 
order polynomial, as represented by Eq. 2, in accordance with one 
embodiment of the present invention, where D u and D v represent the two 
varying parameters or conditions. As such, the conditions, and the 

30 represented color values, in Eq. 1 varies in two dimensions, D u and D v . 
The quadratic polynomial in Eq. 2 is fit to the dataset of color values 
associated with a particular color channel. 

Per color channel, the coefficients for the equation are stored. In 
35 one embodiment, the coefficients are stored in a table, per color channel 



22 



HP1001 10200 



such as, Table 2 illustrated below. Table 2 illustrates the coefficients for 
Eq. 2 for a color channel contained within an exemplary pixel. The 
exemplary pixel has three color channel that in combination form the 
entire spectrum of colors available to be displayed in the pixel, in one 
5 embodiment. The pixel is comprised of three color channels: red, green, 
and blue. 



Table 2 



RED 


Green 


Blue 


Al 


Al 


Al 


A2 


A2 


A2 


A3 


A3 


A3 


A4 


A4 


A4 


A5 


A5 


A5 


A6 


A6 


A6 



; io 

Table 2 of illustrates entries of coefficients for Eq. 2 for the color 
II channel of the exemplary pixel. In the "RED" column, the various 
f f coefficients (Al - A6) of the second order polynomial function that 

represents the color values of the red subpixel across the defined set of 
15 conditions are stored. In the "GREEN" column, the various coefficients 
(Al - A6) of the second order polynomial function that represents the 
color values of the green subpixel across the defined set of conditions are 
stored. In the "BLUE" column, the various coefficients (Al - A6) of the 
second order polynomial function that represents the color values of the 
20 blue subpixel across the defined set of conditions are stored. 

In another embodiment, instead of solving for separate red, green, 
and blue PTM equations for each pixel that is displayed, the luminance 
over the color channels in each of the pixels is solved. Since the 
25 luminance effect is relatively uniform over each of the color channels in 
a particular pixel, only one set of coefficients need be stored to solve the 
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luminance for that particular pixel given a set of conditions. As such, a 
parametric texture map is used to reconstruct luminance for each pixel. 

In particular, in present embodiment takes advantage of the 
5 luminance redundancy by computing an unsealed color per pixel 
(R n (u,v), G n (u,v), B n (u,v))) that is modulated by a luminance model, 
L(u,v) that is again dependent on the pixel, as follows: 
R(u,v) = L(u,v)R n (u,v); 

G(u,v) = L( u, v)G n ( u, v); and (5) 
10 B(u, v) = L(u,v)B n (u, v). 

In one embodiment, the luminance equation can be represented by Eqn. 
K° 2 as modified below: 

Q L(u,v;l u ,l v) = a 0 (u,v)l u 2 + a/u,v)l„ 2 + (6) 

©15 a 2 (u,v)l u l v + a 3 (u,v)l u + a 4 (u,v)l v + a 5 (u,v) 

§4 

S j where l u , and l v represent the two varying parameters or conditions. As 
, such, the coefficients a 0 through a 5 are stored as well as the unsealed 

red, green, and blue colors per pixel. 

5=1 

% As previously mentioned, the user can choose to leave one of the 

§■•* parameters in the set of varying parameters constant for representing 

one-dimensional (ID) functions. For example, time variant functions 

can be represented in this manner, such as a photographic sequence of a 
25 scene as time varies during the day. Thus, the desired dataset would 

contain photographs throughout the day to reflect the variation of time 

on the subject. 

Other conditions or effects, can be represented by the parametric 
30 texture map in one or more dimensions, such as, focus conditions (focus 
depth, depth of focus, etc.); reflectance properties of the object, volume 
rendering, etc. 

While the invention has been illustrated and described by means 
35 of specific embodiments, it is to be understood that numerous changes 
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and modifications may be made therein without departing from the 
spirit and scope of the invention as defined in the appended claims and 
equivalents thereof. 



25 



